Assessing current handover practices in surgery: A survey of non-consultant hospital doctors in Ireland.

BACKGROUND: Handovers of care are potentially hazardous moments in the patient journey and can lead to harm if conducted poorly. Through a national survey of surgical doctors in Ireland, this paper assesses contemporary surgical handover practices and evaluates barriers and facilitators of effective handover. METHODS: After ethical approval and pre-testing with a representative sample, a cross-sectional, online survey was distributed to non-consultant hospital doctors (NCHDs) working in the Republic of Ireland. A mixed-methods approach was used, combining data using triangulation design. MAIN FINDINGS: A total of 201 responses were received (18.5%). Most participants were senior house officers or senior registrars (49.7% and 37.3%). Most people (85.1%) reported that information received during handover was missing or incorrect at least some of the time. One-third of respondents reported that a near-miss had occurred as a result of handover within the past three months, and handover-related errors resulted in minor (16.9%), moderate (4.9%), or major (1.5%) harm. Only 11.4% had received any formal training. Reported barriers to handover included negative attitudes, a lack of institutional support, and competing clinical activities. Facilitators included process standardisation, improved access to resources, and staff engagement. CONCLUSIONS: Surgical NCHDs working in Irish hospitals reported poor compliance with international best practice for handover and identified potential harms. Process standardisation, appropriate staff training, and the provision of necessary handover-related resources is required at a national level to address this significant patient safety concern.

Performance in Irish Selection and Future Performance in Surgical Training.

Importance: Selection processes for surgical training should aim to identify candidates who will become competent independent practitioners and should aspire to high standards of reliability and validity. Objective: To determine the association between measured candidate factors at the time of an Irish selection and assessment outcomes in surgical training, examined via rate of progression to Higher Specialist Training (HST), attrition rates, and performance as assessed through a multimodal framework of workplace-based and simulation-based assessments. Design, Setting, and Participants: This retrospective observational cohort study included data from all successful applicants to the Royal College of Surgeons in Ireland (RCSI) national Core Surgical Training (CST) program. Participants included all trainees recruited to dedicated postgraduate surgical training from 2016 to 2020. These data were analyzed from July 11, 2016, through July 10, 2022. Exposures: Selection decisions were based on a composite score that was derived from technical aptitude assessments, undergraduate academic performance, and a 4-station multiple mini-interview. Main outcomes and measures: Assessment data, attrition rates, and rates of progression to HST were recorded for each trainee. CST performance was assessed using workplace-based and simulation-based technical and nontechnical skill assessments. Potential associations between selection and assessment measures were explored using Pearson correlation, logistic regression, and multiple linear-regression analyses. Results: Data were available for 303 trainees. Composite scores were positively associated with progression to HST (odds ratio [OR], 1.09; 95% CI, 1.05-1.13). There was a weak positive correlation, ranging from 0.23 to 0.34, between scores and performance across all CST assessments. Multivariable linear regression analysis showed technical aptitude scores at application were associated with future operative performance assessment scores, both in the workplace (ß = 0.31; 95% CI, 0.14-0.48) and simulated environments (ß = 0.57; 95% CI, 0.33-0.81). There was evidence that the interpersonal skills interview station was associated with future performance in simulated communication skill assessments (ß = 0.55; 95% CI, 0.22-0.87). Conclusions and Relevance: In this study, performance at the time of Irish national selection, measured across technical and nontechnical domains in a multimodal fashion, was associated with future performance in the workplace and in simulated environments. Future studies will be required to explore the consequential validity of selection, including potential unintended effects of selection and ranking on candidate performance.

Collating evidence to support the validation of a simulated laparotomy incision and closure-training model.

BACKGROUND: It is essential to evaluate the functionality of surgical simulation models, in order to determine whether they perform as intended. In this study, we assessed the use of a simulated laparotomy incision and closure-training model by collating validity evidence to determine its utility as well as pre and post-test interval data. METHOD: This was a quantitative study design, informed by Messick's unified validity framework. In total, 93 participants (surgical trainees â€‹= â€‹80, experts â€‹= â€‹13) participated in this study. Evaluation of content validity and the models' relationships with other variables was conducted, along with a pre and post-test confidence assessment. RESULTS: The model was deemed realistic and useful as a teaching tool, providing strong content validity evidence. In assessment of relationships with other variables, the expert group out-performed the novice group conclusively. Pre and post-test evaluation reported a statistically significant increase in confidence levels. CONCLUSION: We present strong validity evidence of a novel laparotomy incision and closure simulation-training model.

Generating a Prioritized List of Operative Procedures for Simulation-based Assessment of General Surgery Trainees Through Consensus.

OBJECTIVE: To develop appropriate content for high-stakes simulation-based assessments of operative competence in general surgery training through consensus. BACKGROUND: Valid methods of summative operative competence assessment are required by competency-based training programs in surgery. METHOD: An online Delphi consensus study was conducted. Procedures were derived from the competency expectations outlined by the Joint Committee on Surgical Training Curriculum 2021, and subsequent brainstorming. Procedures were rated according to their perceived importance, perceived procedural risk, how frequently they are performed, and simualtion feasibility by a purposive sample of 30 surgical trainers and a 5-person steering group. A modified Copenhagen Academy for Medical Education and Simulation Needs Assessment Formula was applied to the generated data to produce ranked procedural lists, which were returned to participants for re-prioritization. RESULTS: Prioritized lists were generated for simulation-based operative competence assessments at 2 key stages of training; the end of 'phase 2' prior to the development of a sub-specialty interest, and the end of 'phase 3', that is, end-of-training certification. A total of 21 and 16 procedures were deemed suitable for assessments at each of these stages, respectively. CONCLUSIONS: This study describes a national needs assessment approach to content generation for simulation-based assessments of operative competence in general surgery using Delphi consensus methodology. The prioritized procedural lists generated by this study can be used to further develop operative skill assessments for use in high-stakes scenarios, such as trainee progression, entrustment, and end-of-training certification, before subsequent validity testing.

Assessing operative competence in core surgical training: A reliability analysis.

BACKGROUND: This study quantifies the number of observations required to reliably assess the operative competence of Core Surgical Trainees (CSTs) in Ireland, using the Supervised Structured Assessment of Operative Performance (SSAOP) tool. METHODS: SSAOPs (April 2016-February 2021) were analysed across a mix of undifferentiated procedures, as well as for three commonly performed general surgery procedures in CST: appendicectomy, abdominal wall hernia repair, and skin/subcutaneous lesion excision. Generalizability and Decision studies determined the number of observations required to achieve dependability indices ≥0.8, appropriate for use in high-stakes assessment. RESULTS: A total of 2,294 SSAOPs were analysed. Four assessors, each observing 10 cases, can generate scores sufficiently reliable for use in high-stakes assessments. Focusing on a selection of core procedures yields more favourable reliability indices. CONCLUSION: Trainers should conduct repeated assessments across a smaller number of procedures to improve reliability. Programs should increase the assessor mix to yield sufficient dependability indices for high-stakes assessment.

Post-pneumonectomy syndrome: a systematic review of the current evidence and treatment options.

OBJECTIVES: Post-pneumonectomy syndrome (PPS) is rare and predominantly characterised by dynamic airway obstruction due to mediastinal rotation at any time point following pneumonectomy. The objective of this systematic review was to identify the optimal treatment strategy for PPS based on subjective symptomatic relief, objective radiological imaging, and treatment durability. METHODS: A systematic review was performed up to and including February 2022 based on the "Preferred Reporting Items for Systematic Reviews and Meta-Analyses" guidelines. All studies that presented the management of symptomatic patients > 16 years of age with radiologically confirmed PPS were included. The primary outcome was the identification of the optimal treatment strategy and the secondary outcome was durability of the treatment. The Oxford Centre for Evidence Based Medicine level was assigned to each study. RESULTS: A total of 330 papers were identified and reviewed; 41 studies met the inclusion criteria. Data including patient demographics, indication for initial pneumonectomy, presenting symptoms, management approach, outcomes, and follow-up were assessed and analysed. Management approaches were divided into three categories: (a) mediastinal repositioning using implant prostheses; (b) endobronchial stenting; (c) other corrective procedures. One hundred and four patients were identified in total and of those, 87 underwent mediastinal repositioning with insertion of a prosthetic implant. Complications included over- or under-filling of the prosthesis (8.5%) and implant leakage (8.9%). CONCLUSION: Management of PPS using a prosthetic implant to reposition the mediastinum is the treatment of choice. Key adjuncts to optimise surgical approach and minimise complications include pre-operative CT volumetric analysis to guide implant size and intra-operative transoesophageal echocardiography to guide mediastinal repositioning.

Baseline Assessments of Psychomotor Aptitude Are Associated With the Future Operative Performance of Surgical Trainees: A Prospective Observational Cohort Study.

OBJECTIVE: This study sought to investigate the association between validated psychomotor ability tests and future in-theater and simulated operative performance. BACKGROUND: Assessments of visuospatial ability, perceptual ability, and manual dexterity correlate with simulated operative performance. Data showing the predictive value of such assessments in relation to future performance in the workplace is lacking. METHODS: Core surgical residents in Ireland recruited from 2016 to 2019 participated in assessments of baseline perceptual, visuospatial, and psychomotor ability; Pictorial Surface Orientation (PicSOr) testing, digital visuospatial ability testing, and manual dexterity testing. Operative performance was prospectively assessed using the in-theater Supervised Structured Assessment of Operative Performance (SSAOP) tool, and simulation-based Operative Surgical Skill (OSS) assessments performed over a 2-year core training period. SSAOP assessments were scored using a 15-point checklist and a global 5-point operative performance score. OSS assessments were scored using procedure-specific checklists. Univariate correlations and multiple linear regression analyses were used to explore the association between fundamental ability measures and operative performance. RESULTS: A total of 242 residents completed baseline psychomotor ability assessments. Aggregated fundamental ability scores were associated with performance in submitted workplace-based SSAOP assessments using the Total Checklist score ( P =0.002) and Overall Performance scores ( P =0.002), independent of operative experience, and undergraduate centile scores. Aggregated ability scores were also positively associated with simulation-based OSS assessment scores on multivariable analysis ( P =0.03). CONCLUSION: This study indicates that visuospatial, psychomotor, and perceptual ability testing scores are associated with the future operative performance of surgical residents.

Training and assessment using the LapSim laparoscopic simulator: a scoping review of validity evidence.

INTRODUCTION: The LapSim (Surgical Science, Sweden) laparoscopic simulator is a high-fidelity virtual reality simulator for use in endoscopic surgical training. This review critiques the current validity evidence for the LapSim laparoscopic simulator, specifically with respect to its potential use as a tool and method of training and assessment in surgery. METHODS: A scoping review of the MEDLINE (PubMed), EMBASE, Cochrane and Web of Science databases was conducted in accordance with PRISMA guidelines (2020)-scoping review extension. Articles were included if they presented validity evidence for the use of the LapSim in operative skill training or assessment, in accordance with Messick's validity framework. European Association of Endoscopic Surgeons (EAES) guidelines (2005) were used to provide recommendations for the use of the LapSim in operative performance training and assessments. RESULTS: Forty-nine articles were included. An EAES level 2 recommendation was provided with regard to the internal consistency reliability of automated performance metrics in assessing performance. An EAES recommendation of 2 was awarded with respect to the ability of the LapSim to discriminate based on case volume and overall laparoscopic experience (relationships with other variables). Performance assessment metrics on the LapSim correlate with improved performance in the operating room (EAES level of recommendation 1-consequential validity). CONCLUSION: The LapSim has accumulated substantial evidence supporting the validity of its use in surgical training and assessment. Future studies should explore the relationship between the achievement of performance benchmarks on the LapSim and subsequent patient outcomes, and interrogate the benefits of implementing virtual reality simulation training and assessment curricula in post-graduate surgical training programmes.

Perspectives on simulation-based assessment of operative skill in surgical training.

INTRODUCTION: The perspectives of the wider surgical community toward simulation-based assessment (SBA) in training is a gap in the literature. This study aims to explore the factors associated with the acceptable use of SBA in surgical training, through the perceptions and experiences of a broad range of stakeholder representatives, building on findings from a review of the published literature. MATERIALS AND METHODS: Ten semi-structured interviews were conducted, using a sequential transformative qualitative methods approach, with representatives from identified key stakeholder groups; executive management, risk management, a practicing surgeon, an anaesthesiologist, a theatre-nursing representative, a representative from simulation industry, a patient, a medical student, a junior surgical trainee, and a senior surgical trainee. Interview transcripts underwent reflexive thematic analysis using an inductive and constructivist framework (NVIVO software, NVIVO 12, QSR International). RESULTS: Four themes emerged: the 'need' for SBA, the concept of a 'minimum standard', the 'optimum design' of an SBA framework, and 'fairness'. SBA is a potential solution to challenges in the current training environment. It emerged that it should not replace trainer judgement, but could ensure that trainees meet a minimum operative competency standard. SBA should be used to identify underperforming trainees early in training to provide targeted remediation. The application of SBA in high-stakes settings such as trainee selection, autonomy granting, and end-of training certification has perceived benefits over current assessment methods. CONCLUSIONS: This study builds on findings from prior research to explore factors regarding the acceptable use of simulation as an assessment method in surgical training, including perspectives from a broad range of stakeholder representatives. Findings can inform the development of simulation-based assessment curricula in surgical training.

Defining operative experience targets in surgical training: A systematic review.

BACKGROUND: The surgical learning curve is an observable and measurable phenomenon. Operative experience targets are well established as a proxy measure for operative competence in surgical training across jurisdictions. The aim of this study was to critique the available evidence regarding the relationship between operative experience in surgical training and trainee competence. METHODS: A systematic review of the PubMed, Embase, Web of Science, and Cochrane library databases was conducted in accordance with the Preferred Items for Systematic Reviews and Meta-Analyses guidelines. Articles were sought that defined the relationship between procedural volume in surgical training and trainee competence, proficiency, or mastery. The educational impact of included studies was evaluated using a modified Kirkpatrick model. RESULTS: Of 3,672 records identified on database searching, 30 papers were ultimately included. Fourteen studies defined operative experience thresholds using operative time as a surrogate measure of competence, whereas another 8 used trainer assessments of operative performance (Kirkpatrick level 3). A further 5 studies were able to determine the relationship between trainee case volumes and subsequent patient outcomes (Kirkpatrick level 4b). CONCLUSION: Many studies have recorded competent trainee performance in key index procedures after reaching experience threshold numbers in excess of currently mandated targets across jurisdictions. The evidence relating current operative experience targets to patient outcomes across a range of surgical subspecialties of surgical subspecialties is lacking. This review supports a move toward criterion-based referencing of operative performance targets in surgical training.

Assessing Operative Skill in the Competency-based Education Era: Lessons From the UK and Ireland.

INTRODUCTION: Decisions regarding the operative competence of surgical residents in the United Kingdom and Ireland are informed by operative workplace-based assessments (WBAs) and operative number targets for index procedures. This review seeks to outline the validity evidence of these assessment methods. METHODS: A review of the MEDLINE (Pubmed), EMBASE and Cochrane Library databases was undertaken in accordance with the Joanna Briggs Institute Protocol for Scoping Reviews (2020). Articles were included if they provided evidence of the validity of procedure-based assessments, direct observation of procedural skills, or indicative operative number targets. The educational impact of each article was evaluated using a modified Kirkpatrick model. RESULTS: Twenty-eight articles outlining validity evidence of WBAs and operative number targets were synthesised by narrative review. Five studies documented users' views on current assessment methods (Kirkpatrick level 1). Two articles recorded changes in attitudes towards current operative assessments (level 2a). Ten studies documented the ability of current assessments to record improvements in operative competence (level 2b). Ten studies measured a change in behaviour as a result of the introduction of these assessments (level 3). One article studied the ability of operative assessments to predict clinical outcomes (level 4b). CONCLUSIONS: Operative WBAs are reliable. Scores achieved correlate with both time spent in training and recorded operative experience. Trainers and residents have concerns regarding the subjectivity of these assessments and the opportunistic nature in which they are used. Operative number targets are not criterion-referenced, lack validity evidence, and may be set too low to ensure operative competence.

Effect of Pseudomonas colonisation on lower limb venous ulcer healing: a systematic review.

OBJECTIVE: Pseudomonas aeruginosa is a Gram-negative bacillus that commonly colonises lower limb venous ulcers. Its effects on venous ulcer healing are widely debated. It produces exotoxins and elastase, as well as forming biofilms in hard-to-heal wounds. It is postulated that these virulence factors lead to slower healing times in patients with lower limb venous ulcers colonised with Pseudomonas. This review aimed to summarise the available evidence pertaining to this topic. METHOD: A systematic review was performed in August 2019, where the Pubmed, Cochrane and Embase databases were searched for relevant literature according to PRISMA guidelines. Retrospective and prospective studies examining the effect of Pseudomonas colonisation on any measure of ulcer healing were included. RESULTS: Some 282 articles were screened, of which seven studies including 491 patients were ultimately included for analysis. Of these, no study demonstrated a significant association between Pseudomonas colonisation and delayed healing of venous ulcers. In five of the seven studies, the effect of Pseudomonas aeruginosa on initial ulcer size at presentation was recorded. CONCLUSION: All the studies demonstrated an association between ulcer size and the presence of Pseudomonas aeruginosa. While Pseudomonas aeruginosa may colonise larger ulcers or those with a worse prognosis, no evidence was found to support the hypothesis that this colonisation had a negative impact on lower limb venous ulcer healing.

Training to proficiency in surgery using simulation: is there a moral obligation?

A deontological approach to surgical ethics advocates that patients have the right to receive the best care that can be provided. The 'learning curve' in surgical skill is an observable and measurable phenomenon. Surgical training may therefore carry risk to patients. This can occur directly, through inadvertent harm, or indirectly through theatre inefficiency and associated costs. Trainee surgeon operating, however, is necessary from a utilitarian perspective, with potential risk balanced by the greater societal need to train future independent surgeons.New technology means that the surgical learning curve could take place, at least in part, outside of the operating theatre. Simulation-based deliberate practice could be used to obtain a predetermined level of proficiency in a safe environment, followed by simulation-based assessment of operative competence. Such an approach would require an overhaul of the current training paradigm and significant investment in simulator technology. This may increasingly be viewed as necessary in light of well-discussed pressures on surgical trainees and trainers.This article discusses the obligations to trainees, trainers and training bodies raised by simulation technology, and outlines the current arguments both against and in favour of a simulation-based training-to-proficiency model in surgery. The significant changes to the current training paradigm that would be required to implement such a model are also discussed.

Outcomes of Acute Limb Ischaemia in Patients with Underlying Malignancy: A Systematic Review.

OBJECTIVE: Previous studies have demonstrated amputation and mortality rates to be 14.3% - 30% and 11.4% - 28.9%, respectively, for all patients presenting with acute limb ischaemia (ALI). Rates of ALI are higher in patients with malignancy than in those without. Despite this, there remains uncertainty with regards to the most appropriate management for patients with cancer presenting with ALI. This is because of previously published high rates of associated morbidity and mortality in this population. The aim of this review was to summarise the available evidence reporting on outcomes of ALI in patients with underlying malignancy. METHOD: A systematic review was performed in August 2020 in accordance with the PRISMA guidelines. The Medline, Scopus, Cochrane, and Embase databases were searched with the following search string ((acute limb ischaemia) OR (acute limb ischemia)) AND ((cancer) OR (malignancy)). A total of 849 papers were identified and reviewed; six studies were included. Studies were assessed for bias using the National Institute of Health/National Heart, Lung and Blood Institute Quality Assessment Tool. Data including demographics, Rutherford classification, baseline performance scores, method of revascularisation, and peri-procedural outcomes were extracted and analysed. Data were pooled based on outcomes of interest and pooled prevalence was reported with 95% confidence intervals (CI). RESULTS: Six studies with 284 patients with cancer were included for analysis. The pooled overall risk of amputation was 15% (95% CI 5.9 - 26.9). The pooled 30 day mortality rate was 24% (95% CI 14.7 - 34.6). CONCLUSION: Despite limitations of interstudy selection bias and some clinical heterogeneity, the included studies demonstrated acceptable short and medium term outcomes for patients with cancer undergoing revascularisation for acute limb ischaemia. This is in line with current recommendations that patients with underlying malignancy should be considered strongly for revascularisation.

How do Trainers and Trainees use Formative Workplace-based Assessments of Operative Competence to Deliver and Receive Structured Feedback?

OBJECTIVE: The aim of this study is to assess the quality of feedback provided to surgical trainees in the operating theatre, and to further investigate how trainees and trainers use workplace-based assessment in practice with regards to frequency and timing of assessments. DESIGN: A retrospective study of all submitted Supervised Structured Assessments of Operative Performance (SSAOPs) from April 25, 2016 to February 2, 2021 was conducted. SETTING: Surgical trainees in the Republic of Ireland across all national surgical training sites submitted SSAOPs through an online platform. PARTICIPANTS: Assessments of operative competence (SSAOPs) from all Core Surgical Trainees (in their first two years of dedicated post-graduate surgical training) were included for analysis, regardless of surgical subspecialty. A total of 2294 assessments were submitted from April 25, 2016 to February 2, 2021 by 330 core surgical trainees and 379 surgeon assessors. Five hundred of these assessments were randomly selected and scored for quality of feedback using a modified "Task, Gap, Action (TGA)" framework. RESULTS: Of all 2294 submitted assessments, 1905 (83.04%) were submitted in the latter 3 months of each rotation, and 803 (35%) were submitted in the last month. Only 51 of 270 (18.89%) of trainees in their first year and 33 of 236 trainees in their second year (13.98%) submitted more than the minimum required number of assessments (6 per year). Of 500 randomly selected assessments, 362 (72.4%) had documented written feedback. The mean 'Gap' and 'Action' scores were low, at 0.44/3 and 0.53/3 respectively. CONCLUSIONS: Trainees do not submit more than the required number of operative workplace-based assessments. Assessments are submitted at the end of the trainee's rotation, limiting their formative value. The quality of written feedback is poor and could be improved significantly by encouraging a "Task," "Gap" and "Action" approach.

Perceptions and experiences of simulation-based assessment of technical skill in surgery: A scoping review.

INTRODUCTION: The introduction of simulation-based assessment raises questions as to its role in trainee selection, progression, certification and credentialing. This study sought to review and critique the available research regarding the perceptions and experiences of residents and their trainers towards simulation-based assessment of technical skills in surgery. METHODS: A comprehensive literature review of the Medline (PubMed), Embase, Cochrane and Web of Science databases was performed in accordance with the Joanna Briggs Institute 2020 protocol for scoping reviews in July 2020, for all original research articles, abstracts and conference proceedings assessing the attitudes, perceptions, opinions and experiences of residents and surgical trainers toward simulation-based assessment of technical or operative skill. RESULTS: A total of 1869 studies were identified on database searching. Quantitative, qualitative and mixed-methodology publications reporting the attitudes and experiences of surgical trainers and residents were identified, with 21 articles ultimately meeting the inclusion criteria for (qualitative) thematic analysis. Results were charted and categorized into broad themes: 1) Perceptions of simulation-based assessment in principle, 2) Entrustment, 3) Credentialing and certification, and 4) Resident selection and recruitment, identifying both positive perceptions and key areas of concern from residents and trainers alike regarding the current and future application of simulation-based assessment. CONCLUSION: There is broadly positive agreement amongst residents and surgical trainers in the published literature regarding the validity of simulation-based assessment. Perceptions of the broader application and implications of simulation-based skill assessment has been identified as a gap in the literature. Future studies should aim to record comprehensive data from key stakeholders prior to implementation of a simulation-based assessment curriculum to ensure acceptability.

Open repair of a type II endoleak facilitated by temporary disconnection of graft components.

Endoleaks are a frequent indication for reintervention after endovascular repair of an abdominal aortic aneurysm. Here we present a method of open repair of a persistent type II endoleak involving graft component separation and reconstruction, in a patient with symptomatic interval aneurysmal sac enlargement despite endovascular coiling and embolization. This case report demonstrates an alternative open technique of endograft component separation and reconstruction that may be required in cases where open repair with sac exploration and vessel oversewing is hindered by the graft position.

Hybrid covered endovascular reconstruction of the aortic bifurcation (CERAB) procedure is preferable to aortobifemoral bypass for limb-threatening aortoiliac occlusive disease during the COVID-19 crisis.

The COVID-19 pandemic is disrupting the provision of acute vascular surgery across the globe. Limited evidence of the impact of nosocomial infection on patient outcomes as well as concerns about critical care capacity will likely have an impact on surgical decision-making. Endovascular therapy offers a way by which perioperative risk can be reduced for vascular patients while also reducing the impact of acute surgery on intensive care unit capacity. This case report describes the management of a patient with complex aortoiliac occlusive disease by a hybrid endovascular approach in light of these constraints, with a successful outcome.